Link to QAT Instruction Tuned model broken
In the model card, you provide this link to the instruct tuned version of this model: https://huggingface.co/google/gemma-3-27b-pt-qat-q4_0-gguf/blob/main/hf.co/google/gemma-3-27b-it-qat-q4_0-gguf
But the link appears to be dead, I get a 404
Can confirm, the link is broken for LMstudio. Manual download works though. The links of the IT is broken too
how to download manualy to lmstudia?
@Andriyy
you have to click the right quant green q4_0 button to open the details on the right. In the upper right corner of that is a download button.
Once you download the model you have to put it into your LMStudio folder, which you will find in the LMstudio Settings (Developer mode).
For it to work in vLLM you may need a config from another hugging face repo though.
EDIT: they fixed the link, LMstudio workes now
Thanks @nils-rethmeier ,
@jackatparallel , Could you please confirm if the issue is resolved or are you still encountering the same issue? Thank you.